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^ | \ Abstract 

We study sequences of empirical measures of Euler schemes associated to some non- 
Markovian SDEs: SDEs driven by Gaussian processes with stationary increments. We 
obtain the functional convergence of this sequence to a stationary solution to the SDE. 
Then, we end the paper by some specific properties of this stationary solution. We 
P I . show that, in contrast to Markovian SDEs, its initial random value and the driving 

Gaussian process are always dependent. However, under an integral representation 
assumption, we also obtain that the past of the solution is independent to the future 
of the underlying innovation process of the Gaussian driving process. 
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1 Introduction 



The study of steady state of dynamical systems is very important for many experimental 
sciences like Physics, Chemistry, or Biology, since very often measure can only be obtained 
in that regime. In the Markovian setting the study of long time behavior and stationary 
^ ■ solutions of dynamical systems is a classical domain of both Mathematic and Probability. 

Nevertheless in many situations the driving noise of the dynamical system has long range 
dependence properties and the solution is not Markovian. 

In this paper, we deal with an Revalued process (X t ) t >o solution to the SDE of the 
following form: 

dX t = b{X t )dt + dZ t (1) 

where {Zt)t>o is a continuous centered Gaussian process with ergodic stationary incre- 
ments. For this class of SDEs, our principal aim is to approximate some stationary so- 
lutions under some mean-reverting assumptions on b and weak assumptions on (Zt)t>o 
including ergodicity of the discrete increments that will be made precise in the next sec- 
tion. Note that, since for any matrix a, (Z t )t>o = (o-Z t )t>o is also a continuous centered 
Gaussian process with stationary ergodic increments, SDEs of type ([T]) include the follow- 
ing ones: dXt = b{Xt)dt + adZt- However, we can remark the main restriction: we do 
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not consider the case where a is not constant. It allows us on one hand to avoid techni- 
calities related to stochastic integration and on the other hand to generalize some results 
of [7J, when the driving noise is not a fractional Brownian motion. Please note that, when 
b(x) = —x, the solution of ([1]) is an Orstein-Uhlenbeck type process, where the driving 
process may be more general than a fractional Brownian motion (see [3] for a study of 
fractional Ornstein-Uhlenbeck processes). We obtain bounds for a discrete version of this 
generalized Ornstein-Uhlenbeck process, which are an important tool in our proofs and 
which may have interest of their own (see Lemma [2]) . 

In this work, our approach is quite different to that of [7J. Actually, we choose to first 
approximate stationary solutions of an ergodic discrete model associated with ([1]). Then, 
stationary solutions of the SDE are exhibited as limits of these stationary solutions. More 
precisely, in a first step, we study a sequence of functional empirical occupation measures 
of an Euler scheme (X„ 7 ) with step 7 > associated with ([T]) and show under some 
mean-reverting assumptions on b, that, when n — > +00, this sequence has almost surely 
(a.s. later on) some weak convergence properties to the distribution of a stationary Euler 
scheme with step 7 of the SDE. Denoting these stationary solutions by y(°°>T) ) we show 
in a second step, that (Y(°°' 7 )) 7 is tight for the uniform convergence on compact sets and 
that its weak limits (when 7 — > 0) are stationary solutions to ([I]). 

For a Markovian SDE, this type of approach is used as a way of numerical approxi- 
mation of the invariant distribution and more generally of the distribution of the Markov 
process when stationary (see [19], [11], [12], [13], [18], [TT] ) . Here, even if the discrete 
model can be simulated, we essentially use it as a natural way of construction of station- 
ary solutions of the continuous model and the computation problems are out of the scope 
of this paper. 

In Section [2J we make the mathematical framework precise and we state our main re- 
sults of convergence to the stationary regime of SDE ([1]). Then, Sections [3j H] and [5] are 
devoted to the proof of the main results. First, in Sections [3] and [31 we study the long 
time behavior of the sequence (X n ^) n>l (when 7 is fixed) and the convergence proper- 
ties (when n — > +00) of the sequence of functional empirical occupation measures of the 
continuous-time Euler scheme. We show that this sequence is a.s. tight for the topology of 
uniform convergence on compact sets and that its weak limits are stationary solutions to 
the "discretized" SDE. Second, in Section [5l we focus on the behavior of these weak limits 
when 7—7-0. In Section [H we give some properties of the stationary solution. We first 
show that the initial random value and the driving process are dependent as soon as the 
Gaussian process has dependent increments. However, assuming some integral represen- 
tation of Z (with respect to a white noise), we then prove that the past of the stationary 
solution that are built with our method, are independent to the future of the underlying 
innovation process of Z. Please note that a similar result is also proven in the discrete 
case for the stationary Euler scheme associated with the SDE. Section [7J is an Appendix 
where we obtain some control of the moment of the supremum of a Gaussian process and 
a technical Lemma showing that we can realize the stationary solutions with the help of 
an innovation representation of the driving process. 

2 Framework and main results 

Before outlining the sequel of the paper, we list some notations. Throughout this paper, 
M+ = [0,oo). We denote by C(M + ,M d ) (resp. D(M+,]R d )) the space of continuous (resp. 
cadlag functions) endowed with the uniform convergence on compact sets (resp. Skorokhod 
(see e.g. [2])) topology, and by C fc (R+, M. d ), the set of kth differentiable functions. The 
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Euclidean norm is denoted by | . | . For a measure fx and a //-measurable function f, we 
set n(f) = J fdfj,. Finally, we will denote by C every non explicit positive constant. In 
particular, it can change from line to line. 

Let us first consider assumptions for the driving noise (Z t )t>o = (Zj, . . . , Zf) t >o : we 
assume that (Z t )t>o is a centered Gaussian process satisfying Zq = and, for every 
i G {1, ... ,d}, we denote by q : IR — > R + , the following function of (Zl)t>o- for every 
positive s,t, 

n(zi-zi) 2 } = Cl (t- S ). 

Note that Cj(0) = 0. For every integer n > 0, let us denote by A n = Z ni — Z( n _ 1 y / when 
7 > is fixed. Setting (fL{n) := E[A^A^ +1 ] for i = 1, we have: 

= ~ [ci((n + 1)7) - 2 Ci (n 7 ) + a{(n - 1) 7 )] • (2) 

We denote by {Z t )t>o the "discretized" Gaussian process defined by Z n7 := Z ni for every 
n > and, 

Z t = Z ni Mt G [n7, (n + 1)7). 

We introduce assumption (Hi) on the functions Cj, i G {l,...,d}. More precisely, we 
impose some conditions on the second derivative of q near and +00 which correspond 
respectively to some conditions on the local behavior and on the memory of the process. 



(Hi) For every i G {1, . . . , d}, Ci is continuous on M + and C 2 on (0, +00). Moreover, there 
exist en G (0, 2) and bi > such that: 

wwi < l ct ~: vte(o ' i) (3> 

Let us recall that for a fractional Brownian motion with Hurst index H, these assumptions 
are satisfied with at = bi = 2 — 2H. One can also check that (J3j) implies that in a 
neighborhood of 0, 

't if a t G (0,1), 

Ci(t) < C Itlnt ifoi = l, (4) 
k t 2 -^ ifoi€(l,2). 

In particular, the sample paths of (Zt)t>o are almost surely continuous. Futhermore, we 
derive from assumption (Hi) that for every i G {1,... ,d}, E[A\A l n ] — > as n — > +00. 
Then, it follows from [1] that (A n ) n >i is an ergodic sequence, i.e. that for every F : 
(R d ) n -> R such that E[|F((A n ) n >i)|] < +00, 

1 - 

- F((A k ) k > n ) ^±^> E[F((A n ) n >i)]. (5) 
n k=i 

Let us now introduce some stability assumptions (H2) and (H3) concerning the stochastic 
differential equation 

dX t = b{X t )dt + dZ t , (6) 
where b : M. d — > M. d is a continuous function. 
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(Ha): 

(i) There exists C > such that \b(x)\ < C(l + \x\) Vx G 

(ii) There exist (3 G K and a > such that 

(x, < P — a|x| 2 . 



(H3): 6 is a Lipschitz continuous function and there exist a > and /3 > 0, such that 

Vx, y G M d , 

(6(x) - 6(y), x - y) < - a\x - y\ 2 . 
When (H3) holds for (3 = 0, we will denote it by (H^o). 

Remark 1. The reader can check that (H3) for some a > 0, (3 > implies (H.2)(ii) for 
some < a' < a and ($' > (3 by taking y = in (H3). As well, the fact that b is Lipschitz 
continuous implies (Hs)(i). One may argue that the Lipschitz assumption is too strong for 
our purpose but we chose to keep this assumption for two reasons. First, this assumption 
is only needed for the SDE in continuous time (i.e. the 2. of Theorem [T]). Second it is a 
convenient way to have the sub linearity assumption (H2)(i). 

When b is a Lipschitz continuous function, it is obvious using Picard iteration arguments 
that for any initial random variable £ a.s. finite there exists a unique solution (Xt)t>o 
to © such that Xq = £ which is adapted to the filtration cr(£, Z s , < s < t). Then, 

Xt = Z+ f HX s )ds + Z t , Vt > 0. (7) 
J 

Please note that the integral in ([7]) is always defined since the sample paths of (Xt)t>o 
and (Z t )t>o are continuous. 



Let us now define a stationary solution to ©. 

Definition 1. Let b : R d — > R d be a continuous function. We say that (X t ) t > is a 
stationary solution to © if 

(X t -X - f b(X s )ds) t > k (Z t ) t > , (8) 
J 

where the equality is the equality of all finite dimensional margins, and if for every n G N, 
for every < t\ < t2 < ■ ■ ■ < t n , 

(X t+tl ,...,X t+tn )^(X tl ,...,X tn ) Vt>0, 

c 

where = denotes the equality in distribution. 

Remark 2. Since Z has in general no integral representation like the moving average 
representation of the fractional Brownian motion 

f 00 TJ_ 1 

B H (t) = (t - s). > - (s) + dW s 



we don't have any stationary noise process in the sense of Definition 2.6 in [7]. Actually, our 
definition is closer to the classical definition of invariant measure of Random Dynamical 
System (see [TJ[5]). 
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When (Zt)t>o is a Markovian process, for instance a Brownian motion, it is classical to 
have Xq independent of Z, but in general we cannot have such independence as stated in 
Proposition [5] (see Section [6]). 

Definition 2. Let v denote a probability on M. d . We say that v is an invariant distri- 
bution for dU) if there exists a stationary solution (X t )t>o to ([1]) such that v = C(Xq). 

Remark 3. The fact that Xq and (Zt)t>o may be dependent involves that uniqueness of 
the invariant distribution does not imply uniqueness of stationary solutions to flSJ). 

Let 7 be a positive number. We will now discretize equation ([B]) as follows: 

y (n+ i )7 - y„ 7 = jb(Y ni ) + A n+ i Vn > 0. 

Y t = Y rn Vt€ [n 7) (n + 1) 7 ). ^ 

We will say that {Yt)t>o is a discretely stationary solution to (E 7 ) is solution of (E 7 ) 
satisfying: 

(Y tl+ky , . . . ,Y tn+kl ) k (Y tl , . . . ,Y tn ) V0 < h < . . . < tn,Vn,k G N. 

We denote (X ni ) the Euler scheme defined by: Xq = x G M. d and for every n > 

-X"(n+i)7 = X nj + ^b(X nj ) + A n+ i. (9) 

Then, we denote by (Xt)t>o the stepwise constant continuous-time Euler scheme defined 
by: 

X t = X ni Vt€ [717,(71 + 1)7). 
The process (Xt)t>o is a solution to (E 7 ) such that Xq = x. For every k > 0, we define by 
(Xj 7fc ^) t > the (7fc)-shifted process: X^^ = X lk +t- 

Then, a sequence of random probability measures {V^ n \uj, dot)) n >\ is defined on the Sko- 
rokhod space D(M + ,R a! ) by 

n 

fe=l 

where <5 denotes the Dirac measure. For i > 0, the sequence (7^ ( w ' dy)) n >\ of "marginal" 
empirical measures at time i on R rf is defined by 

j n n 

rp 7 \u,d y ) = -/Z 6 x^-^ (ui) ( d y) = -E^ 7(fc _ 1)+t (u,)(^)- 
fc=i fc=i 

A weak limit of a set P C IB)(IR + , IET^) is a limit of any subsequence of V in D(R + ,M ci ). Let 
us now state the main results. 

Theorem 1. I. Assume (Hi) and (H2). Then, there exists 70 > such that for every 
7 G (0, 70), {V^ n ^\uj, da)) n >i is a.s. tight on 0(M + ,M d ). Furthermore, every weak limit 
is a discretely stationary solution to (E 7 ). 
2. Assume (Hi) and (H3) and set 

W°°' 7 (oj) := {weak limits of (7> (n ' 7) (w, da))}. 

Then, there exists 71 G (0,70) such that (£/°°' 7 (u;)) 7 < 7l is a.s. relatively compact for 
the uniform convergence topology on compact sets and any weak limit when 7—7-00/ 
(£/°°' 7 (w)) 7 < 7l is a stationary solution to ©. 
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The previous theorem states existence of stationary solutions of ([6]), but one can won- 
der about uniqueness of the solutions. We will only consider the special case when (H^o) 
is enforced which is called in the Markovian setting asymptotic confluence (By asymptotic 
confluence, we mean that the distance in probability between two solutions starting from 
two different points x and y tends to when t — > +00). 

Proposition 1. Assume (Hi) and (Hg^). Then, there exists a unique stationary solu- 
tion to ([6]) and to equation (E 7 ), when 7 is small enough. 

The next corollary, whose proof is obvious is nevertheless useful. 

Corollary 1. Assume (Hi) and (H 3i o). Denote by a £ V(C(R + ,R d )), the distribution 
of the unique stationary solution to (pQ) . Then, 

^(M + ,^)(^ (o °' 7) (^,d«)^)^>0 a.s. (10) 

where d B ^ R+ ^d^ denotes a distance on "P(D(R + , R rf )) (endowed with the weak topology), 
the set of probabilities on M. d . In particular, 

d Rd {V {co ^\uj,da),v) ^>0 a.s. (11) 
where v is the unique invariant distribution of and, d^d is a distance on V(M. d ). 

We will not study the rate of convergence relative to (|lip in this paper. 

Remark 4. We chose in this paper to work with the stepwise constant Euler scheme 
because this continuous-time scheme is in a sense the simplest to manage. The default is 
that the previous convergence result is stated for the Skorokhod topology. Replacing the 
stepwise constant Euler scheme by a continuous-time Euler scheme built by interpolations 
would lead to a convergence result for the topology of uniform convergence on compact 
sets. 

Although Z is not supposed to have an explicit integral representation with respect to a 
Wiener process, and that the setting of the Stochastic Dynamical System (in short SDS) 
of [7J seems hard to use in our work, let us start a brief comparison of our results with those 
of [7J if {Zt)t>Q is fractional Brownian motion. First, our assumption (H3) is a stability 
assumption a little weaker than (Ai) in [7j. Likewise (H2) (i) and b Lipschitz continuous 
are similar to (A2) for N = 1 with Hairer's notation. In [7J Stochastic Dynamical System 
(SDS Definition 2.7) and a Feller semigroup Qt ((2.4) in [7J) are defined on M d xC(l + ,K d ). 
The first marginal of a stationary measure [i on M. d x C(M+, M rf ) defined in section 2.3 of [7J 
is what we call an invariant measure in Definition [2l Moreover V^ n '^ for large n and small 
7 are natural approximations of the stationary measures of [7j . 

3 Tightness of {V {nn) {uj, da)) n >i 

The main result of this section is Proposition [2] where we show the first part of Theorem [TJ 
i.e. we obtain that {V^- n ^ (u, da)) n >\ is a.s. tight for the Skorokhod topology on D(M + , M d ) 
when 7 is sufficiently small. A fundamental step for this proposition is to obtain the a.s. 
tightness for the sequence of initial distributions (Vq (u), da)) n >i. This property is 
established in the following lemma. 
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Lemma 1. Assume (Hi) and (H2). Then, there exists 70 > such that for every 7 < 70, 

1 n 

SU P~ \ X l(k-l)\ 2 < +°° a - S - ( 12 ) 



n>l n , 
— fe=l 



Proof. We have : 

|X( n+1 ) 7 | 2 = |AVy| 2 + 2^(X m , b(X n j)) + 2{X n ~ n A„_|_i) 



+ ( 7 2 |6(X„ 7 )| 2 + 2 7 (6(X n7 ), A n+1 ) + I A 



n+l\ 



Let e > 0. Using assumption (H2)(i) and the elementary inequality \(u, v)\ < ^(|eti| 2 + 
|i>/e| 2 ) (for every u,v e M rf ), we have: 



|(X„ 7 ,A n+ i)| < ^ (^e|X n7 | 2 + ^|A n+ i| 2 ^ and 



|(6(X n7 ), A n+ i)| < - I eC(l + |X n7 | 2 ) + -|A n+1 

It follows from assumption (H2)(ii) that for every e > 0, 

\X (n+lh \ 2 < \X ni \ 2 + 2 7 (/3 - o|X n7 | 2 ) +p( 7 ,e)(l + \X n ^\ 2 ) + C(e, 7 )|A n+1 | 2 

where C(7, e) is a positive constant depending on 7 and e and p(7, e) < C(e + je + 7 2 ). 
Then, set e = 7 2 (for instance). For 7 sufficiently small, p(j,e) < aj/2. Hence, we obtain 
that there exist /3sM and a > such that Vn > 

\X {n+1)l \ 2 < \X ni \ 2 + 7 (/3 - a\X ny \ 2 ) + C|A n+1 | 2 
Finally, by induction, one obtains for every n > 1: 



< (l- 7 a)|X n7 | 2 + C( 7 +|A n+1 | 2 ). (13) 



\X ni \ 2 < (1 - 7 d)>| 2 + C£(l - 7 «) n " fc (7 + I A 

fe=i 

Hence, in order to prove (|12p . it is enough to show that for 7 sufficiently small 

n— 1 k 



supi^^(l-d7) fc ~'|A/| 2 < +00 a.s. (14) 

But 

£ £(1 - « 7 ) fc -'|A z | 2 = £ |A fc | 2 £(1 - d 7 )" < C^|A fc | 2 < c£ £(A* 

fc=l 1=1 k=l u=0 

and it follows that it is in fact enough to show that 

1 n 

sup-^(Ay 2 < +00 a.s. Vie (15) 

Now, by ©, 



r)>1 n 

n ^ x k=l 1=1 



n k 11 n—k n d n 

k=l 1=1 k=l u=0 k=l i=l k=l 



n>l n , 
— k=l 



i^(Al) 2 ^±^E[(Ai) 2 ], 



n 

k=l 



and (|Toj) is satisfied. This completes the proof. □ 
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Proposition 2. Assume assumption (Hi) and (H2). Then, there exists 70 > such 
that for every 7 < 70, (V^ n '"'\uj,da)) n >i is a.s. tight on D(K_) 



Proof. We have to prove the two following points (see e.g. [2], Theorem 15.2): 

• 1. VT > 0, (nP(u,dy)) defined by 

n 

nP(uj,dy) = V<5 ,vM) n(dy), 

' — » \ su Pte o,t l A t Lr 
fc=l 

is an a.s. tight sequence. 

• 2. For every r\ > 0, 



1 n 

lim sup lim sup - E <%4(x(fc-D = a - s - 



with 

w' T (x, 5) = inf {max sup |xt — x s \} 

{U} i<r Sjt e[ti,ti +1 ) 

where the infimum extends over finite sets {ti} satisfying: 

= to < t\ < . . . < t r = T and inf(ij — > 5. 

i<r 

In fact, since the process has only jumps at times 717 with n G N, u>' T (X^ k \ 5) = when 
5 < 7. It follows that the second point is obvious. Then, let us prove the first point. By 
induction, one gets from (|13p that, for every k > n, 

k 

\X kl \ 2 < \X m \ 2 (l - 7 a) k ~ n + C U - 7«)* _, (7 + |A Z | 2 ). 

l=n+l 

This implies that 

n+[T/i\ 

sup |xf _1) | 2 = sup \X kl \ 2 < \X n7 \ 2 + C(l+ V |A,| 2 ). 
te[0,T] fee{n,...,n+[T/ 7 ]} ;=n+1 

Thus, if V(x) = |x| 2 , one can deduce: 

1 n 1 n fc+[T/ 7 ] 

M (n W)%E^-ih)+c( 1 +-E E i A 'i 2 
fc=i fc=i i=fc+i 



<sup^ n ' 7) (u;,y) + c(l + - 
n>l V n 



1 n+[Th] 
sup— y lAfcl 2 I < +00 a.s. 



thanks to Lemma[T]and (fT5j) . Therefore, sup n>1 /J^ (w, V) < +00 a.s which implies that 
(fj,ip\uj , dy)) is a.s. tight on R d (see e.g.. [6j, Proposition 2.1.6). □ 
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4 Identification of the weak limits of (V^ 1 ' 7 H W ? da)) n >i 

In the following proposition, we show that every weak limit of (T , ^ n '"'\uj,da)) n >i is a.s a 
stationary Euler scheme with step 7 of SDE ([6]). 

Proposition 3. Assume (Hi) and let V^^iui, da) denote a weak limit of '(V( n,,y \u),da)) r 
Then, a.s., T^ 00 ' 7 )^, da) is the distribution of a cadlag process denoted by Y(°°' 7 ) such 
that, a.s. in w, 

fay (i ( ^ +t )t>o = (i( )t>o / or every t G where = denotes the equality 
in distribution on 1 " 1 '™ 711 



iY(°°'T) denned 6y 



^(00,7) = ^(00,7) _ ^(007) _ b(Y (oo,7) )ds 

Jo 

is equal in law to Z 1 with t^ = 7^/7]. 

Remark 5. It follows from the previous proposition that (1^°° )i>o is a discretely 
stationary solution to (E 7 ). 

Proof, (a) Let T denote a countable dense subset of M + and <S* , a countable dense subset 
of the space of continuous functions / : W — > M with compact support. It suffices to prove 
that a.s., Vr > 0, for every / G , for every t\, . . . ,t r G T,VZ G N, 

f(a tl ,...,a tr )r ( - 00 ^(uj,da)= [ f(a tl+ll ,...,a tr+lj )P^(u,da). 



Since T and are countable, we only have to prove that Vr > 0, for every / G , for 
every t 1} . . . , t r G T, VZ G N, 

J f(a tl ,...,a tr )V^\co,da) = J f(a h+h , ■ ■ ■ , a tr+h )V^\co, da) a.s. (16) 

Let now / G S,r, Z G N and t\, . . . , t r G 7". On the one hand, 
1 n 

fc=i 



n 1 n 

-5J/(-^(fc-l)7+*i>' • • )-^(fc-l)7+tr) ~ -5J/(-^(A-l+07+ti)- • • ' -^(fc-l+07+tr 
fc=l fe=l 

n+Z N 

fc-l)7+tl5 • • • >^(fe-l) 7 +t r ) _ X/ /(^(fc-l)7+*i' • • • '^(*=-l)7+tr) 



\Jfe=l 



k=n+l / 

and this last term converges to when n —> +00 a.s. since / is bounded. On the other 
hand, since "P(°°' 7 )(u;, da) denotes a weak limit of (v( n '^> (cu, da) ) n >i, there exists a subse- 
quence (nk(uj))k>i such that (V^ nk ^'' y \uj,da))k>i converges weakly to V^ 00 ' 1 ^^, da) (for 
the Skorokhod topology). This convergence implies in particular the finite-dimensional 
convergence. Therefore, 



1 n r 

±j:f(xt 1 \...,xt 1) )^ ± ^ f(a h ,...,a tr )V^\u,da) a.s. 
n k=i J 

1 n - f 

and, ^/(4 fe -;),...,^-;))^±^ f( atl+h ,...,a tr+h )V^(oj,da) a.s. 



Therefore, (fT6l) follows. 



(b) Let $ 7 : B(M+,M d ) -> B(M + ,IR d ) be defined by: 

($ 7 (a))t = a t - a - / b(a s )ds. (17) 

JO 

Then, AK°°>7) = ^(F^'T)). Let F : B(R + ,R d ) -> M be a bounded continuous functional: 
E[F(N(°°rt)] = f F(9Ja))P^{u),da) = lim / F($ 7 (a))P (nfc(w) ' 7) (a;, da). (18) 
For every i > 0, 

k+Wf] 
l=k+l 

with the convention = 0. Thus, we derive from (|18|) that 


E [ F(A r(oo,7))] = lim -VfoGdA,)^) 

K m=l 

where G : (R d ) N -> lD)(M + ,lR d ) is defined by 

[|] 

G((n„)„>i) t = y^M; Vi > 0. 

Z=l 

Now, (A n ) n >i is an ergodic sequence (see ([5])). As a consequence, a.s., 

rti. 
ft i=i 

The result follows. □ 

5 convergence 

of (pfrrifa da)) when 7 

The aim of this section is to show that, a.s., {V^- 00 ^ [to, cfa)) 7 is a.s. tight for the weak 
topology induced by the topology of uniform convergence on B(R_|_, M rf ) and that its weak 
limits when 7 — >■ are stationary solutions to ([6]). The main difficulty for this second part 
of the proof of Theorem [2] is to show that ('P ( - 00 ' 7 * ) (u;, da)) 7 is a.s. tight on W 1 . For this 
step, we focus in Lemma[2]on the particular case b(x) = —x (when (X t )t>o is an Ornstein- 
Uhlenbeck process) where some explicit computations lead to a control of da)) 7 . 
Then, in Lemma El we show that this control can be extended to SDE's whose drift term 
satisfies (H3). Finally, we establish the main result of this section in Proposition [4j 

Let 7 > 0. We denote by (S n7 ) the Euler scheme in the particular case b(x) = —x. We 
have T,q = x and: 

S (n+1) 7 = (1 - 7) S n 7 + A n+ i Vn > 0. 



— £ F o Gf((A,),>i) E[F o G((A,)/>i)] = E[F(Z 7 )]. 
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Lemma 2. Assume (Hi) and let 7 G (0, 1). Then, (E[|S n7 | 2 ])„>o is a convergent sequence. 
Denote by ^(7) its limit. For every 70 G (0, 1), 

sup ?; (7) < +00. 

76(0,70] 

Proof. First, by induction, 

n-1 



£ n7 = (1 - 7 ) n * + J> - 7 ) fc A n _ fc . 



k=0 

It follows that 



a n—1 

E[|S n7 | 2 ] = (1 - 7 ) 2n M 2 + E E [( E( X " ^ A n-/, 



i=l fc=0 

For every « G { 1 , . . . , d} , 



n—1 2 n— In— 1 



fc=0 fc=0 1=0 

where 4>\ is defined by ([2]). Setting u = k + I and v = I — k, we deduce that 

n-l 2 2n-2 (2n-2-u)Au 

e[(E(i-7)*au) ] = E(i-7r E <W> ( 19 ) 

fc=0 ' " u=0 w=(ie-(2n-2))V(— u) 

with x Ay = min(x,y) and x V y = max(x,y). Then, with the definition of <fi, one can 
check that 



(2n— 2— u)Au 

E m 

«=(«— (2n— 2))V(-«) 



Cj(7) if u = or it = 2n — 2, 

f?((2n — 2 — u) A u) otherwise, 



with //(x) = Cj(7(x + 1)) — Ci("fx). It follows from (fT9|) that, 

n— 1 2 n— 1 

:[(E( 1 -T)*^i-*) ] = «M + E<! - «M + 



fc=0 n=l 



with 

2n-l 

^(7) = E C 1 - 7) M /7(2« - 2 - u) + (1 - 7 ) 2n - 2 Ci(7), 

u=n 
n-2 

= E (1 " 7) 2n - 2 ^/7(n) + (1 - 7) 2n - 2 Q(7)- 
w=-l 

Since Cj is locally bounded and c" is bounded on [l,+oo[, c, is a subquadratic function, 
i.e. 

\ci{u)\<C{l + \u\ 2 ) Vu>0. 

It follows that fj is also a subquadratic function. Then, using that for every u G 
{-l,...,n-2}, (l- 7 ) 2 "- 2 -" < (l- 7 ) n , we obtain that for every 7 G (0,1), ^(7) — ► 
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as n — > +00. 

Using again that / 7 is a subquadratic function, we deduce that for every 7 G (0,1), for 
every i G {1, ...,d}, 



n- 1 2 +°° 

E[(^(l- 7 fAU) ] ^^^(7) :=c,( 7 )+^(l-7rW 

k=0 u=l 

and that ^(7) is finite. By a second order Taylor development, we have for every 14 > 1: 

/7(«) = 7Ci(7«) + tM7>w) with r(j,u) = ^(j(u + u )), 6 U G [0,1]. 
Hence, using assumption (Hi), it follows that 



hoc 

Wi{i) = Ci(i) + ^7(! - 7)" [c'i(l u ) +T r ('y,u)] with |r(7, u)\ < Cg^u), 

u=l 



and, 9i,i{t)=t ai l{tg( ,i)} +* 6ll {t>i}- 

Let us now control the behavior of 101(7) when 7 — > 0. First, for every 7 G (0, 1), for every 
ii > 1, (1 — 7) n < exp(— 7n). Then, since t 1— )■ exp(— i), t 1— >■ 5^1 (t) are non-increasing on 
Ml, one deduces that for every u > 2, 



Then, 



7(l-7) n 5i,i(7«) < / exp(-t) 5i ,i(t)dt. 

J7(u-1) 



+00 „ +oc 

^ 7 2 (l-7) n r(7, U )| <q(7)(1-7) + C 7 / exp(-t)^i(t)dt. 

u=i J -y 



Using that < 2, we easily check that the right-hand side is bounded and tends to 
when 7—7-0. We now focus on the first term of u>j(7). First, by assumption (Hi), for 
every t > 0, 

\4(t)\<C(l + g i>2 (t)) where g h2 (t) = i 1 ^ 1 l {te(0jl)} + ^ +5a l {t > 1} , (20) 

with 5\ G (0, 1) (resp. 8% G (0, 1)) if a% = 1 (resp. 6j = 1) and 5\ = (resp. 52 = 0) 
otherwise. Second, using that (1 — 7)" < C(l — 7)" 1 exp(— t) for every t G [714,7(14 + 1)], 
one deduces that 

ff 7 " ,,exp(-t)tPdt if o < 

7(l-7) u (7«r<C T^+i \ / (21) 

I — J 7 « exp(-t)f <ft if p > 

It follows from (El and (EZTJ) that 

f +00 



lim sup 

7-i>0 



^7(1-7)^(71*) 



u=l 



r+00 

<C exp{-t) (1 + g^{t)) dt. 
Jo 



The right-hand member is finite. This completes the proof. □ 

Lemma 3. Assume (Hi) and(H 3 ) and denote byV^°°' J \u;,da) a weak limit of ' (V^'^^co, da)). 
Then: 

(i) With the notations of Proposition [H there exists 70 > such that, 

sup Ejy (oo,7) | 2 ] < +00 a.s. (22) 

0<7<7o 

(ii) Assume (Hi) and (H3o). Then, uniqueness holds for the distribution of stationary 
solutions to ([8]). Similarly, there exists 70 > such that for every 7 < 70, uniqueness 
holds for the distribution of discretely stationary solutions to (E 7 ). 
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Proof, (i) 

Step 1: Let (X n ~) and (Xn 7 ) be defined by: 

X = x, X {n+l y f = I„ 7 + lb(X ni ) + A n+1 and, (23) 
So = x, S( n+1 ) 7 = £ n7 — 7S n7 + A n+ i. 

with A n = Z ni - ^( n _i) 7 . Then, 

|X( n+1 ) 7 — S( n+1 ) 7 | 2 = |X n7 — X„ 7 | 2 + 2 7 (6(X n7 ) + S n7 , X n j — S„ 7 ) + 7 2 |6(X n7 ) + X„ 7 | 2 
< \X ni - S n7 | 2 + 2 1 (b{X ni ) - 6(S n7 ),X n7 - S n7 ) + 2 7 2 |6(X n7 ) - 6(£„ 7 )| 2 
+ 27(6(S n7 ) + S„ 7 ,X n7 - S n7 ) + 27 2 |6(S n7 ) + £„ 7 | 2 . 

On the one hand, using that b is Lipschitz continuous and assumption (H3), one obtains: 

7(6(X n7 )-6(S n7 ),X n7 -S n7 ) + 2 7 2 |6(X n7 )-6(S n7 )| 2 < 7 (/3 + \X ni - S„ 7 | 2 (-a + C 7 )) . 

(24) 

On the other hand, using that 6 is a sublinear function and the elementary inequality 
(u, v) < l/2{e~ l \u\ 2 + e\v | 2 ) (with u = 6(S n7 ) + S n7 , u = X ny — S n7 and e = a/2), one 
also has: 

7(6(S n7 ) + S„ 7 , A > n7 -S n7 ) + 27 2 |6(S n7 ) + S n7 | 2 < 7^|X n7 -S n7 | 2 + C7(l + |S n7 | 2 ). (25) 
Therefore, the combination of (|24p and ([25p yields for sufficiently small 7: 

\ X {n+l)-y ~ S (n+l) 7 | 2 < (1 ~ "7)|Xi 7 ~ S ™ 7 | 2 + C 7 (l + |S„ 7 | 2 ) 

where a is a positive number. Then, it follows from Lemma [21 

E[\X (n+lh - S (n+1)7 | 2 ] < (1 - a 7 )E[|X n7 - S n7 | 2 ] + h 

where f3 does not depend on 7. By induction, we obtain: 

+00 3 

su P E[|X n7 - S„ 7 | 2 ] < /3 7 V(l - o 7 ) fc = ^ < +00. 

n>l un a 

— k=0 

Finally, since 

E[|X„ 7 | 2 ] < 2 (E[|X n7 - S n7 | 2 ] + E[|S n7 | 2 ]) , 
it follows from Lemma [2] that there exists 70 > such that 

sup sup E[|X n7 | 2 ] < +00. (26) 

0<7<7o n>l 

Step 2: First, since sup n >! ^ Y2=i l^(fc-i) 7 | 2 = su Pn>i ^^{u, \x\ 2 ) < +00 a.s. (by 
Lemmad]), the fact that P (oo ' 7) (w, da) is a.s. a weak limit of V^'^ '(oj,da) implies that 

Ej^o (0 °' 7) | 2 ]<+cx) a.s. 

By Proposition 13(b), there exists a.s. a Gaussian process Z w with the same distribution 
as the driving process of the SDE such that 

y^+ll = y n ( 7 °°' 7) + 7^n ( 7 °°' 7) ) + A n+1 . (27) 
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with A n := — Zf n _^ . Moreover, by Remark E u [|yi™ | 2 ] does not depend on n 

since the sequence (Y^'^) is stationary. Let now (X®) be constructed as in (f23j) with 
sequence (A n ) of (|27p . By (|26p . the lemma will be true if we are able to show that for 
sufficiently small 7, 

limsupEjA%-Y n ^)| 2 ] <C (28) 

n— >+oo 

where C does not depend on 7. The process of the proof of (|28p is quite similar to Step 
1. First, using assumption (H3), one checks that: 

l*(n+i) 7 " ^(i+'ihl 2 < l^vy - 1^' 7) | 2 (1 - «7 + C7 2 ) + /?7 a.s. 

For sufficiently small 7, 07 — C7 2 > ja/2. Setting a = a/2, one derives from an induction 
that: 

EjX (n+1 ) 7 - Y^| 2 ] < (1 - a 7 ) n E.[|^ " Yt' j) \ 2 } + ^£(1 " <^)* -> f ■ 

fc=0 

This concludes the proof of (i). 

(ii) First, we prove uniqueness for the distribution of a stationary solution to SDE ([6]): 
let (Y t: i)t>o and (l^,2)t>o be some stationary solutions to ([6]) driven respectively by Z 1 
and Z 2 . We want to show that for every T > 0, for every bounded Lipschit^l] continuous 
functional F : C{[0,T},M. d ) -> R, 

E[F(Y t>1 , < t < T)} = E[F(Y t;2 ), < t < T)). (29) 

Let (X£i) and (Xf 2 ) be some solutions to ([6]) starting from x and built with the previous 
driving processes Z 1 and Z 2 respectively. First, since b is Lipschitz continuous, a classical 
argument shows that weak uniqueness holds for solutions to © starting from any deter- 
ministic x E M. d . As a consequence, X\ and have the same distribution on C(M+,M c! ). 
Thus, using that Y_% and Y 2 are stationary, we obtain that for every s > 0: 

E[F(y i)] -E[F(y 2 )] = E[F(Y t+s>1 ,0 < t < T)] - E[F(X? +S>1 , < t < T)] 

+ E[F(Xf +Sj2 , < t < T)] - E[F(Y t+s>2 , < t < T)]. 

Since F is a bounded Lipschitz continuous functional, it follows that for every s > 0, 

2 

|E[F(Y 5l )]-E[F(Y, 2 )]| <C^E[ sup |Y M - X£| A 1]. 

i=1 te[ s ,s+T] 

In order to obtain (i29l) . it is now enough to prove that 

sup\Y tti — Xfi\ °°> a.s., z = 1,2. 

Set V? = |y M - X^| 2 . We have: 

dVi = 2(b(Y tii )-b(X? >i ),Y tii -Xf ii ). 
1 for the standard distance S defined for every a, ft € C([0, T],R d ) by 5(a,0) = sup tg [ T j ja t — /3t\. 
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Thus, it follows from (Hg) with (3 = and from the Gronwall lemma that, 

\Y t>i - Xff < (Y - x) 2 exp(-2at). 

Therefore, 

sup \Y t4 - XfA 2 < (Y - x) 2 exp(-2as) '^ + °°> a.s., z = l,2. 

t>s 

This concludes the proof of the uniqueness for the distribution of a stationary solution 
to ([6]). For Equation (E 7 ), the proof is a straightforward adaptation of the previous one. 
Details are left to the reader. □ 

Proposition 4. Assume (Hi) and (H3). Then, there exists 70 > such that a.s. 
(V^ 00 '^ (uj, ^a)) 7 e(o,7o) * s relatively compact for the topology of uniform convergence on 
compact sets. Furthermore, any weak limit of (T , ^°°'' y \uj, tfa)) 7 g(o,7 ) (when 7 — > 0) is the 
distribution of a stationary solution to SDE © . 

Proof. Step 1: A.s. tightness of {V^Xu, da)): For w e O, we recall that y(°°>7) is a 
cadlag process with distribution T^ 00 ' 7 '^, dot). According to Theorem VI. 3. 26 of |10j . we 
have to show the two following points: 

• For every T > 0, there exists 70 > such that 

limsup sup P( sup |y/°°' 7) | > K) = 0. (30) 
A'^+oo 76(0,70] te[o,T] 

• For every positive T, e and 77, there exist 5 > and 70 > such that for every 
7 < 7o, 



P( sup _y s (°o, 7 )| > £ ) <^ (31) 



\t-s\<S,0<s<t<T 

First, we focus on (f30"|) . Let K > 0. By Proposition [31 we have: 

P( sup |Y/°°' 7) | > K) < P ( |y (oo ' 7) | + [ T \b(Yj°°^)\ds + sup |Z 7 | > if ] . 
te[o,T] \ jo te[o,T] y 

Using the Markov inequality, it follows that 

P( sup |y/°°' 7) | > K) < \- I E[|Y ( °°' 7) |] +CT sup E[|y^)|]+E[ sup \Z t \}) 
te[o,T] K \ ne{o,...,[T/ 7 ]} te[o,T] / 



where ||cr|| = sup{|<rx|/|a;|, x G R }. Now, since (Y ni ) is a stationary sequence and 
sup te r 0i <n \ Zt\ is integrable (see Proposition [8]) , one obtains: 

P( sup |lf°' 7) | >K)<% (l + E[|Y (oo ' 7) | ' 
te[o,T] ^ v 

where C does not depend on 7. Finally, the first point follows from Lemma EJ 



Let us now prove (f3Tj) . In fact, using for instance proof of Theorem 8.3 of [2j, it is enough 
to show that for every positive e, 77 and T, there exist 5 > and 70 > such that for every 
7 < 7o: 

-P( sup |Y t (oo ' 7) - y0».7)| > e ) < r? V7 < 7o and < t < T. (32) 

t<s<t+<5 
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By the Markov inequality, we have for every p > 1: 



sup | Y t 

t<s<t+8 



(oo.7) _ y-(oo, 7 ) 



> I I - I E 



+ 1 



t+<5 



|6(yi°°^)|d s 



sup \Z]-Z?\ P 

s€[t,t+S] 



On the one hand, 
pt+6 

E " ' 



\b(Yt' 7) )\ds 



< E 



< E 



£ vWt1H^' 7) )I) 

fc=[t/7] 
'[(*+*)/7l \ /[(*+<5)/7l 

£ 7 £ tIK^ 00 '' 1112 

fc=[*/7] / \fc=[*/7] 



thanks to the Cauchy-Schwarz inequality. Now, when 7 is sufficiently small 

l{t+S)/H 
£ 7 < 2-5. 

Mt/7] 

Therefore, using also the fact that b has sublinear growth yields: 



E 



t+s x 2 

|6(n (0Q,7) )|ds 



(33) 



< C5 2 (l+ 



sup E[|y fc ( 7 °°' 7) | 2 ]) < c^(i+E[|y ^f]) 

r(t+a)i 



thanks to the stationarity of (lri7°' 7 ^)n>0- 
On the other hand, we deduce from the stationarity of the increments of [Zt)t>o that 



'(00,7) |2j 
(34) 



E 



sup \Z]-Z?\ P 
se[t,t+S] 



< E 



SUP \Z S — Z t 

sE[t,t+S] 



< E[ sup \Z S \ P ] 
se[o,<5] 



Thus, by Proposition [8] (see Appendix), for sufficiently large p, 



E 



sup \Z?-Z?\ P 
se[t,t+S] 



< CS 1+P 



where p is a positive number 
Then, the combination of 



and (|35|) yields for sufficiently small 7: 



(35) 



sup |y/°°' 7) - y,(°°-T)| > e < C6 2A( - 1+ ri 

,t<s<t+5 J 



and ()3ip follows from Lemma [3l 



Step 2: We want to show that, a.s, any weak limit V(uj,da) of ("P^ 00 ' 7 -'^, da))~ when 
7 — )• (for the uniform convergence topology) is the distribution of a stationary process. 
Let / : R r — > R be a bounded continuous function and let t > and ii, . . . , t r such that 
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< t± < . . . < t r . Denoting by (Yt)t>o a process with distribution ^(uj, da), we have to 
show that: 

E[f(Y tl+t , Y tr+t )} = E[f(Y tl ,...,Y tr )}. (36) 

First, since V{uj, da) is a weak limit of (T , ^ 00 '"'\uj, da)) y , there exist some sequences (7 n )n>o 
and (F(°°'T«)) n >o such that £(Y^°°'^) = V^°°^ n \uj,da) and (Y t {cor ' n) ) converges weakly 
to (Yt) for the weak topology induced by the uniform convergence topology on compact 
sets on B(R+,R d ). In particular, 

E[/(y/ i 00 ^ ) ,...,y t (° * ) )] ^+^ E[f( Y ti ,...,Y tr )} and, (37) 
nf(Y t ^\ Ygg?)] nf(Y tl+t , . . . , Y tr+t )]. (38) 

L -In ' -In 

since i~ := 7 n [^/7n] t when n — > +00. Now, by Proposition [31 

E[f(Y t {°°^\ Yt' ln) )\ = E[f(Y t ^\. . . , y£g*>)] Vn > 1. 



follows. 

Step 3: Let $ : B(R + ,R d ) B(R+,R d ) be defined by 

(®(a)) t = a t - a - b(a s )ds. 

Jo 

With the notations of Step 2, we want to show that Y := {Y t )t>o is a solution to ([6]), i.e. 
that $(!") is equal in law to Z := (Z t ) t > . Let (j n ) and (y(°°>7n)) 

„>o be defined as in Step 
2. Then, since <3? is continuous for the uniform convergence topology on compact sets, 

$(y(°°,7n)) ™^±?° ( 39 ) 

for the weak topology induced by the uniform convergence topology on compact sets. 
Therefore, we have to prove that 

$(y(oo l7 n)) "^±?° Z , (40) 

for this topology. With the notations of Proposition [31 

$(y(oo, 7n )) =iV (oo, 7 „) + R y n where R j n = _j b(Yj°°'^)ds. (41) 

-In 

First, since b is sublinear and t — i < j n , we have for every T > 0: 

|^ 7 "| < C 7n (l + sup |y/°°^|) Vi € [0,T]. 
ie[o,T] 

Now, in Step 1, we showed that (sup t6 r 0) r] | y^ 00 ' 7 ^ |) 7e (o, 70 ) is tight on R. It follows easily 
that 

sup l^ 7 "! "^ + °°) in probability VT > 0. 

te[o,T\ 



Therefore, one derives from (|39p and (|4ip . 

Then, it follows from Proposition [3] that jV^ 00 ' 7 ™) is a convergent sequence of Gaussian 
processes such that A^ 00 ' 7 ™) = Z ln . This implies the finite-dimensional convergence to 
(Z t )t>o and concludes the proof. □ 
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6 Properties of the stationary solution 



In this section, we give some properties of the stationary solution. In Subsection 16.11 we 
prove that the random initial value of a stationary solution can only be independent of a 
Gaussian noise with independent increments. In Subsection 16.21 we prove that however, 
an independence property holds between the past of the stationary solution and the future 
of the so-called innovation process. 



6.1 Dependence between X and Z 

Proposition 5. Let Xq and (Zt)t>o denote the random initial value and the driving 
process of a stationary solution to ©. Then, if Xq is independent of (Z t )t>o, then (Z t )t>o 
has independent increments. As a consequence, Z = QW where W is a standard d- 
dimensional Brownian Motion and Q is a deterministic matrix. 

Proof. Let X := (Xt)t>o be a stationary solution to © and assume that Xq is independent 
of Z := (Zt)t>o- First, note that for every t > 0, Zt+. — Zt = ip(Xt+.) where ip : 
C(R + ,M d ) -> C(M+,IR d ) is defined for every a G C(M+,M d ) by 

ip{a)t = at — cto — / b(a s )ds Vt > 0, 



o 



is continuous. Then, since (Xt) is stationary, it follows that for every bounded continuous 
functional F (for the topology of uniform convergence on compact sets), for every s > 0, 
for every t > 0, and every bounded continuous function / : M. d — > R, 

E[(/(* ) " nf(Xo)}) F(Z S+U -Z s ,u> 0)] = E[(f(X t ) - E[f(X t )}) F^(X t+s+ .))} 

= E[(f(X t ) - E[f(X t )]) F(Z t+s+u - Z t+Sl u>0)\. 

Since Xq is independent of Z, 

E[(f(X ) - E[/(X )D F{Z S+U -Z s ,u> 0)] = 0. 

This implies that 

E[f(X t )F(Z t+s+u -Z t ,u> 0)] = E[f(X t )]E[F(Z t+s+u - Z t+S ,u> 0)]. 

One deduces that for every s, t > 0, such that < s < t, X s is independent of (Z t+U — 
Zt)u>o- As a consequence, for every positive u, t, for every i,j G {1, . . . , d}, 

E[Zl(Zl +u -ZD) 

E[Xj(Zi +u - ZD] - j\[b\X v )(ZU u - Zl)]dv - E[X^(Zi +u - Zi)}^j , 

'E[X}]E[Zi +u - Z(] - f\[b\X v )]E[Zl +u - Zl\dv - E[Xi\E[Zl +u - Z{]\ . 
= 0. 

Since Z is a centered Gaussian process, it clearly implies that Z has independent incre- 
ments. □ 
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6.2 Independency to the future of the underlying innovation process 

In order to ensure a physical sense to the stationary solutions built with our discrete 
approach, it may be important to check that for every t > 0, a(X s ,0 < s < t) does not 
depend on the innovation generated by the future of the Gaussian process Z after t (see 
below for a precise definition). In the simple case where Z is a Brownian motion (whose 
increments are independent), it is natural to define the innovation after t as the cr-field 
generated by the increments of the Brownian motion after t. Then, a stationary solution of 
a SDE driven by Z is meaningless if o~(X s , < s < t) is not independent of the increments 
of Z after t. This is the case for (X t )t>o defined by 

/+oo 
e l - s dZ s 

which is a stationary solution (in the sense of Definition [1]) to dXt = Xfdt + dZt but whose 
initial value X = — / + °° e~ s dZ s depends on all the future of Z (Note that (X t ) t > does 
not satisfy Assumption (H2)). Thus, the aim of this section is to show that our construc- 
tion of stationary solutions as weak limits of ergodic Euler schemes does not generate such 
a type of stationary solutions. 

This section is divided in two parts. We focus successively on the discrete case, i.e. on the 
stationary solutions to (E 7 ) and on the continuous case, i.e. to the stationary solutions 
to ©. Oppositely to the rest of the paper, we will need in the two following parts to 
introduce series or integral representations in order to define the innovation of (A n ) and 
Z respectively. We will also assume that d = 1. 

The discrete case. Assume that (A n ) n >i is a purely non-deterministic sequence. Then, 
by Theorem 3.2 of [9], there exists a sequence of real numbers denoted by (ak^)k>o such 
that (A„) n >i admits the following representation: 

+00 

A ra = ^ afc, 7 Cn-fc a.s., Vn > 1, (42) 

k=0 

where (6c)fcez> is a sequence of i.i.d. centered real-valued Gaussian variables such that 
Var(£i) = 1. The sequence (£fc)fcez is then called the underlying innovation process as- 
sociated with (A n ) n >i. Under the assumptions of Theorem [H we know that for 7 small 
enough, there exists a stationary distribution V°°^ on IR N to the recursive equation 

X(n+i)-y ~ X n -y = 76(A„ 7 ) + A n+1 Vn > 0. (43) 

By Lemma 0] in the Appendix, this stationary distribution V 00 ' 1 can be realized as ki(/xi), 
where /xi denotes the probability measure on MxM z defined by (j54[) such that its projection 
on the second coordinate is £((£ n ) ng z), and where k\ is defined in ([52]) . From now on, we 
denote this stationary solution by (A^ 7 °' 7 ^) n >o. In the next proposition, we show that for 
7 small enough, the past of {X^^ ) n >o is independent of the future of this innovation 
process. 

Proposition 6. Assume (Hi) and (H^o). Let 70 > such that the conclusions of 
Theorem^ hold for 7 < 70 and denote byV 00 '^ the unique stationary distribution on M N to 
(|43p . Let (A^' 7 ) ri >o denote the realization ofV 00 ^ on ]RxlR z defined previously. Then, for 
7 small enough, for every n > 0, cj(A > q 00 ' 7 ' ) , . . . , A ? i 7 °' 7 ' > ) is independent to a(£,k, k > n+1). 
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Remark 6. For the sake of simplicity, we stated Proposition[6]under (H^o) which ensures 
uniqueness of the distribution of the stationary solution. However, adapting the arguments 
of the proof to subsequences, it could be possible to show that, under (Hi) and (H2) only, 
there exists 70 > such that for every 7 < 70, a.s., every weak limit of 'p( n > n /> (cj, da) (as 
n — > +00) is the distribution of a stationary solution to (E 7 ) that satisfies the preceding 
independence property. Note that the same type of remark holds for Proposition [7] below. 

Proof. It is enough to prove that for every integers N% and N2 such that N2 > N\, for 
every bounded continuous functions Hi and H2, 

ElH^xt^, . . .,X^ j} )H 2 ^n 1+ i, ■ ■ ■ ,£iv 2 )] 

= Emxt'^, ■ ■ .,X^)]E[H 2 {^ +1 , . . . ,6v 2 )]. (44) 

In order to make use of our previous convergence results, we first write (xg°' 7) ,£ fe ) 

k>l as 

a function of a stationary sequence (X^'^, S^''" l '* > )k>o'- we denote by (E 7 ) the recursive 
equation on R 2 defined for every n > by 

X( n+1 ) 7 — X ni = 7&(X n7 ) + a A n+ i 

We will also denote by (X^ 7 ,5* 7 ) a solution to (E 7 ) starting from a deterministic point 
(x,s), by {{Xf , Sf))t>o the induced stepwise constant process and by {{X^ k+ ,S* k+ ) the 
7&-shifted process. Now, one observes that Assumptions (Hi) and (Hs^) are satisfied on 
R 2 for (X t ,S t ) with b(x,s) = (b(x),—s) and A n = (A n , <!;„). Hence, by Theorem[TJl and 
the uniqueness induced by Assumption (Hs^), there exists 70 > such that for every 
7 < 7o> a -S-, for every bounded continuous functional F : D(R + ,R ) — >• R, 

1 n 

-E^^ViH- m^f*™\F) (45) 

k=l 

where p(°°>7) is the unique distribution of a (discretely) stationary solution that we denote 
by (^(oo^s^)). Thus, on the one hand, since (S,k)ke{N 1 +i,...,N 2 } ^ s clearly a continuous 
function G of (<Sjl 00 ' 7 ^)o<fc<iV2' we deduce that a.s., 

E[fTi(*<°°"\ . . . ,X^)H 2 (£ Nl+1 , . . . ,6v 2 )] 

1 n - 

= n^oon E Fl ^7(fc-l)' • • • >^7(fc-l+^l)) F2 ( G ^7(fc-l))' • • • ' ^(fc-i+jV 2 ))) 
fe=l 

1 - 

= n ]j m oo - X/ F l( X 7(fc-l)' • • • ' X ^(k~l+N 1 )) H 2(Ck-l+N 1 , • • • , &-i+JV 2 ). 
fe=l 

(46) 

On the other hand, by ([43]) and the fact that (Ck)k>i is a stationary sequence, we also 
have 

nmixt^' ■ ■ ■ » x 7 ~; 7) )e[# 2 (6v 1+1 , . . . , &v 2 )] 
1 n - 

= lim -^^i(^7(ifc-l)'---^7(fe-l+Ar o^^fe-i+iV!,---,^-^)] a.s- (47) 
k=l 
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Setting 

((k,N 1 ,x) = H 1 (X* k ,...,X* {k+Nl) ) and A(k, N 2 ) = H 2 (£ k+Nl , ■ ■ ■ , £k+N 2 ), 
we deduce from Ji6j) and JJ7]) that (|4"4"|) is true if 

I - 

-J2((k- l,N h x)(A(k- 1,N 2 ) -E[A(fe- 1,N 2 )]) °°> a.s. (48) 

II k=l 

We use a martingale argument. Set Tie = £ Z,k < £). Since A(A;,A r 2) is a 

7ik+N 2 -measurable random variable independent of Hk+N-i and that £(&, N\,x) is Tlk+Nx- 
measurable, we can write: 

£ C(fc " 1 fc Ari '" ) (A(fc - 1, N 2 ) - E[A(Jfe - 1, iV 2 )]) = ^ 

fe=l ' £=JVi 

where for every i 6 {iVi + 1, . . . , Af 2 }, (M^) n >i is a centered ('H n _i + £) n >i-adapted mar- 
tingale defined by: 

M e n = J2 ^ k ~^ Nux) (E[A(fc - 1, iV 2 )/^ fc+ £] - E[A(fc - 1, N 2 )/H k+e -i]) ■ 

k=l 

For every £ G {A' - ! + 1, . . . , N 2 }, (M^) n >! is clearly bounded in L 2 since ifi and H 2 are 
bounded. Thus, setting a k = 1/k and 

b k (u) = C(k - l,N 1: x) (E[A(k - 1, N 2 )/n k+e ] - E[A(k - 1, N 2 )/H k +t-i]) , 

we deduce that the serie ^ a k b k {w) is a.s. convergent and (|48p follows from the Kronecker 
lemma. □ 



The continuous case. We assume in this part that, Z admits the following representa- 
tion: 

Z t = / ft{s)dW s a.s. Vi>0. (49) 

«/ — oo 

where (Wt)t£R is a two-sided standard Brownian motion such that Wo = and for every 
i6R,/ t € L 2 (R,R). 

Following Lemma [5] in the Appendix, the distribution of a stationary solution (Xt)t>o 
to §6$ can be realized as K 2 (fi 2 ), where \x 2 denotes the probability measure on M x C(R,R) 
defined in Lemma 0] such that its projection on the second coordinate is C((Wt)t£R), and 
where k 2 is defined in (|53|) . In the next proposition, we show that the past of the stationary 
solution (X t )t>o is independent to the future of the underlying innovation process of Z. 

Proposition 7. Assume (Hi) and (H^o)- Assume that the representation (|49p holds 
for Z. Let V 00 denote the unique distribution on C(R+,R) of a stationary solution. Let 
(Xt)t>o denote the realization on R x C(R,R) ofV°° defined in Lemma\4\ Then, for every 
t > 0, a(X s , < s < t) is independent of a(W s+ t — Wt, s > 0). 

Proof. Let t > 0. It is enough to show that for every T > 0, for every bounded Lipschitz 
continuous functionals Hi : C([0,t},R d ) ^ R and H 2 : C([0,T],R d ) ^ R 

E[#i(X s ,0 < s < t)^ 2 (iy t+s - W t ,0 < s < T)\ 

= E[H 1 (X s ,0< s < t))E[H 2 (W t+s -W t ,0<s< T)]. (50) 
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As in the proof of Proposition [6l we introduce (Xt, St) that is a stationary solution to 

J dX t = b(X t )dt + dZ t 
| dS t = -S t dt + dW t 

where W denotes the underlying innovation process of the representation (|49p . Following 
the second part of the Appendix (see Lemma H|), we can assume that (X t ,St) is built 
on M 2 x C(R,R). Assumptions (Hi) and (H 3)0 ) are satisfied on M 2 for (X t ,S t ) with 
b(x,s) = (b(x), —s) and Z t = (Z t ,Wt). Let 70 and 71 € (0,70) such that Theorem Q] holds 
for every 7 < 71. Denote by V 00 ' 1 the (unique) stationary distribution of (£7). Denote 
by (A > < 00 ' 7 ,^ 00,7 ) < >0 the stationary solution built on M 2 x C(R,R). Using that 

(W t +s - W t ,0 < s < T) = $(S s+ t)) se[0 , T ] 

where 4>(a) is defined by 

4>(a) s = a s - a + / a u du, 
Jo 

we deduce from Proposition U] and from the continuity of (j) for the uniform topology (on 
compact sets) that 

E[#ipr s ,0 < s < t)H 2 (W t+s -W t ,0 < s < T)] 

= limE^^.O < s < t)H 2 ((4,(S^) se[0 , T] )]. 
7— >o 1 ' 

Now, setting £ n = W ni — Wr n _i\ 7 , we derive from the definition of the discretized equation 
that 

[^] 

where 



*=[*]+! 



\R u (l,t,s)\ = \(t + s-t_±s )S t+s - (t-t )S t \ < 2 7 sup \S^\. 

7 ue[o,t+T] 

Since (S°°' 7 ) 7g (o i71 ] is tight for the uniform topology on compact sets, it follows that 

sup 1^(7, t, s)\ 7 ~^°> in probability. 

se[o,T] 

Thus, using that H 2 is Lipschitz continuous, we deduce that 
E[fTi(X a ,0 < s < t)i? 2 (Wi +fl -Wi,0 < s < T)] 



hmE[^ 1 (A > -' 7 ,0< S <t)^ 2 (( J] a) se[ o,T])]- 



*=[*]+! 

As well, 



E[Fi(X s , < s < t)] = lim E[Fi(X s °°' 7 , < s < t)} 

7— >o 



and, 



[^] 



E[F 2 (iy t+s - W t ,0 < s < T)} = limE[# 2 (( V 6) se [Q,T])]- 
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By the previous convergences, it is now enough to show that for 7 sufficiently small, 



*=[^]+i 



= E[ J f/ 1 (Xr' 7 ,0< S <t)]E[F 2 (( £ &). 6 [o,r|)]- 

fc=[^]+i 

The sequel of the proof follows the lines of that of Proposition We leave it to the 
reader. □ 



7 Appendix 

In the Appendix we give the proof of two technical results. 

Proposition 8. Assume that (Zt)t>o satisfies (Hi). Then, for every T > 0, for every 
r > 0, E[sup te r 0) x] \Zt\ r ] < +00. Moreover, there exist p > 1 and Tq > such that for 
every T < Tq, 

E[ sup \Z t \ p ] < CT 1+P with p > 0. 

te[o,T] 

Proof. First, note that it is enough to prove the result for every coordinate Z 3 with 
j £ {1, ...,£}. Therefore, it is in fact enough to prove that the results are true for 
any one-dimensional centered Gaussian process with stationary increments and variance 
function (c(t)) t >o satisfying (Hi). Then, for every t > and e > 0, c(t) = E[Z t 2 ] and 
denote by V(T, e) the Dudley integral defined by 

V(T,s)= f (log(^(^>)) 1/2 ^, 
Jo 

where, for u > 0, 

N(T, u) = inf{n > 1, 3 s\, . . . , s n such that Vi G [0, T], 3i 6 {1, . . . , n} with \J c(t — Si) < u}. 
By the Dudley Theorem (see e.g. Theorem 1 of |15j p 179), for every T > 0, 

E[ sup |Z t |]<2E[sup Z t ] < CV(T, ^Jc{T)) with c(T) = sup c(t). (51) 

te[o,T] te[o,T] te[o,T] 

Let us control the right-hand member. By assumption (Hi) and (|4]), for every 6 G (0, 1), 

c(<5) <C5 P where C does not depend on 5 and 
H £ (0, 1] (depending on the value of ai). It follows that, for u > 0, 

N(T, u) < CTu 2/p , 
where C does not depend on T. For e > small enough, 

V(T,e) < f \\og(CT) + -\og{u)\ l ' 2 du< Ce\\og{e)\ 1 ' 2 . 
Jo 
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It follows from (|5ip that there exists To > such that for T < To 

E[sup |^|] < C(c(T 1 )) 1 /2| log( c (r)) |i/2 
te[o,T] 

< CT^Ilog^)! 1 / 2 . 

Then by Corollary 3.2 in [13] E[sup fg [ ,T] \Z t \ r ] < +oo for every T > and every r > 
and 

E[ sup \Z t \ p ] < CT^/ 2 |log(T)| p / 2 , 
*e[o,T] 

for T <Tq. One can choose p big enough to prove the second inequality in the Proposition. 

□ 

In this last part of the Appendix, we specify the constructions of the stationary solu- 
tions when (A n ) n >i and (Zt)t>o admit the representations (|42j) and (|49|) respectively. Let 
us first denote by the distribution of the innovation sequence £ = (£ n )nez an d by Av 
the Wiener measure where W = (Wt)teR is a two-sided standard Brownian motion. 

Let ki : R x l z ^ 1 N and k 2 : 1 x C(R,R) -> C(R+,R) be respectively defined by: 

(Cn)nGz))o = (^(x, (W t )tm)o = X, 

+oo 

(kx(x, (Cn)nez))n+i = + tK( k i 0^ 0)n) + X] a k,-yt,n-k for every n > 0, (52) 

fc=0 

and, 

(K 2 (x,(W t ) tm ) t = x+ [ b(K 2 (x,W)) s ds+ [ f t (s)dW s . (53) 

j0 J-oo 

Note that «2 is well-defined fj, — a.s. for all measure such that = Tw (where P2 

denotes the projection of the probability on the second coordinate) since b is a Lipschitz 
continuous function. We are now ready to state that there exist fii and ^2 such that the 
stationary solutions to the discretized and continuous equations (when they exist) can be 
realized on (R x R z ,m) and (R x C(R,R),// 2 ) respectively. 

Lemma 4. (i) Assume that (A n ) n >i admits the representation (|42p . Let V be a proba- 
bility on R N that denotes the distribution of a stationary solution to the discrete recursive 
equation 

^(n+i) 7 - ^n 7 = lb(X ni ) + A n+ i Vn > 0. 

Then, there exists a probability fi\ on R x R z with P2M1 = ^ such that Ki(fii) = V. 
(ii) Assume that (Z t )t>o admits the representation (l4"9j) . LetV be a probability onC(R + ,R) 
that denotes the distribution of a stationary solution to ([6]) . Then, there exists a probability 
[12 on R x C(R, R) with P2H2 = Pw such that ^2(^2) is a stationary solution to ([6]) with 
distribution V . 

Proof (i) First, let 4>\ : R N ->lx R N * be defined by 

<M( x n)n>o) = (xq, (5„)„>i) with 5 n := x n - x n _i - 7&(a; n _i). 

By construction v\ := (t>\(P) defines a probability on R x R N * with P 2 v\ = £((A n ) n >i) 
and such that if (Xo,(A ra ) n >i) has distribution v\, then the induced Euler scheme has 
distribution V . Let T[\(.,dx) denotes the conditional distribution of Xq given (A n ) n >i. 



24 



Let 11 : R z ->• M N * denote the function defined by ft((£ n ) neZ ) = (E^o a fc,7^n-fc)n>i- 
Then, define \i\ on R x R z by 

Mi(da;,de) = 7n(ft(£, dx)) ® P e (d£). (54) 

Setting lZ(x,£) = (x,1Z(£)), it follows from the very definition of fi\ that TZ(fi\) = v\. 
As a consequence, = P. This completes the proof. 

(ii) The proof of the second point is similar and is left to the reader. □ 
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